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ABSTRACT 

In conjunction with the National Science Foundation 
(NSD) , an\ on-going e)Cperiment is being conducted to test the , , 

feasibility ctf ificreasing public access to 16 major data bases by 
"providing public libraries with on-line, interactive, retrieval 
capacity* During the period from January to March 1976, the major 
activities of thp s1:ady were: (1) a continued monitoring tff the, 
number of searches, an Index which showed an increase daring this 
period; (2) a review of typical mistakes made by searchers in the 
public libraries; and (3) the selection of an appropriate format for 
the project's final monograph. This report offers data concerning the 
frequency of searches, co^t information, and a list of errors made by 
searchers. The appendixes summarize the results of Visits to 
participating public libraries, and provide a list of' questions which 
will be answered in the final nonograph, (ENB)v 
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SUMMARY ' /\ 

A large increase in search activity was experienced by the CIN libraries 
in March (a total of 124 search^^ was performed). On the other liand, 
except for the Minneapolis Public Library, the new libraries passing the 
full cost of search on to their patrons show a very low level of search 
activity. A site visit by Applied Commtinication Research to these libaries 
is reported in Appendix A. 

A complete review of searches was made diir^g this quarter to deter- 
mine the types of error by public^^library searchers. The results of this 
review were distributed to the participants fn the form of DIALIB Notes, 
and these are summarized in Section 3. 

An outline of the final report 33aonograph has been prepared (Appendix B)» 
along jsvith a list of questions pertinent to the study (Appendix C). An 
Oversight Committee meeting to review a first draft of the monograph 
will be held in Jime, Summary comments for inclusion In the monograph 
have been solicited from the participants in the study. 
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Section 1 
EVALUATION 

The^maln evaluation activity was a site visit by Dr. Alice Ahlgren of ACR to the four 
new libraries. Her trip report is given in Appendix A, At th^* present time, not 
enou^ questionnaires have be^n returned from the new libraries to allow any generali- 
zations to be made concerning the user reactions, characteristicsp and other evaluation 
information. , ^ { 

The questionnaires and soarch histories for the CIN libraries continue analyzed^ . 
and will be reported on in the final report monograph. 



1. 1 UTILIZATION BY CIN LIBRARIES 



As shown in ^fig. 1, the number of searches performed by the CIN libraries showed a 
steep rise in March. This was partly due to Increased usage of the system by college 
and university students at San Jose and Redwood City. 

The libraries continue to vary considerably in online time per search. For example, 
In March, the time per search and the average search cost for each library is given 
below in Table 1- 

Table 1 

AVERAGE TIME AND COST OF SEARCHES 



Library 


Number of 
Custo^n Searches 


Average Online Time 
Per Search ( min ) 


Average Cost of Search 
(at 1/2 Normal Rate) 


San Mateo County 


' 6 


24.2 


$12.60 


Redwood City 


34 


17.7 


9.85 


San Jose 


57 


10.30 f 


4.74 f 


Santa Clara County 


18 


14.6 


\ 28.14 
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The differences reflect the type of data bases used, complexity of questions bandied, 
and philosophy of reference searching. These topics will be dealt with in the evaluation 
portion of the final report monograph. 

The number of custom searches continues to far exceed the number of standard 
searches; in March, 115 castom searches were performed compared to 9 standard 
searches. The main reason for this is the fact that many of the librarians can perform 
a search on several inexpensive data bases such as EHIC and NTIS at a cost close to 
the $5 flat fee charged £or the standard search. Since the standard search is rjestrlcted 
to ^ single data base, it is advantageous for them to use the custom seai;ph. Another: 
factor that will tend to decrease the use of standard search is DIALOG^s ilnproved 
'Search Save* feature that enables the user to perform the same search on several data 
bases very efficiently (typically 2 to 3 minutes per data base).. V 

1.2 NON-CIN UBRARIES \ , 

\\ ■ 

At the request of the National Science Foundation » In the Fall of 19Y6, four adoltlohal 
libraries were invited to participate in the study.. These were public libraries able to 
pass the full cost of search service on to the patron. The libraries were given free \^ 
terminals and a pool of demonstration time for a 6-month period In return for evaluation 
of the impact of full-cost fees on search volume and the patron response. The libraries 
selected were: 

• Minneapolis Public Library (INFORM), Minneapolis^ Minn. 

• Long Island Library Resources Council , BoUport, Long Island, N.Y. 

• Houston Public Library , Houston , Toxas 

• Cleveland Public Library (Fact for a Fee), Cleveland^ Ohio 

The libraries were provided with terminals,'*' a block of free demonstration time, and 
free training. Their searches were reviewed and comments s^nt to the libraries when 
appropriate. ■ , 



'''Except for Long Island Library Resources Council. 
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1.2.1 Search Activity " 

The search^activity for each of the libraries is shown In Table 2. It will be noted that 
Cleveland took 1 month to gain familiarity with the system before dolng an actual 
.search, while Minneapolis took 2 months, and Long Island 4 months. Houstpn has yet 
to perform an actual search for a fee.. The search activity is quite low, with * 
Minneapolis being the only library that has expended more than one-half hour of search 
time in a given monthi. ^ ' 

Table 2 ' 
SEARCH ACTIVITY OF NEW LIBRAIUES 



Month 



Number of Searches 
Minneapolis Houston Long Island Cleveland 



Sep 1975 yf \ 

Oct 1975 / 

Nov 1975 8 / ' 

Doc 1975 11 

Jan 1976 .1 / - . 

Fob 1976 1 2 2 

Mar 1976 20 , .1 2 

/ Indicates first month in which terminal was used for demonstrations. 
1.2.2 What This Portends 

Ponding a more complete evaluation by Applied Communications Research, we can only 
guess at the following contributing factors: 

• Full Cost Fee . The most obvious factor is that the full-cost fee is just too 
high to allow significant volume to be gGnorilted by modt libraries. 
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• Publicity > The CIN Ub'rariee had 1 year of free service to publicize the 
availability of online search. This allowed a lot of word-of-mouth announce- 
ment of the service. In addition, the CIN libraries were concentrated In a 
small geographical area and thus the publicity can overflow from -one library 
to another, 

• Search Proficiency , The CIN librarians had a lot of practice duiing the first 
year of free service §uid were thus able to develop^a fast search technique. 
This results in low fees to the patrons, and may thus gienerate more search 
activi^ty. Another factor may be the lack of confidence in the new libraries 
in their search proficiency; there may therefore be some reluctance to pro- 
mote and publicize the system, 

• Attitude Toward Fee-Based Service , As Indicated in the ACR report In 
Appendix A, a negative attitude toward fee-based search may be one factor 
in Houston^s non-use of the system. (They were also in the midst of a move 
to a new building,) * 

V • 

This experience with libraries charging full fee indicates that In the third year of full 
cost service the CIN libraries can expect a greatly reduced level of search activity^ 



r 
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Section 2 
PUBLICITY 

» « 

As reported in the Fifth Qu^erly report, 1000 letters were sent out to county and 
city offices and personnel in Santa Clara County, and to a Selected professional com- 
munity (ladora) in San Mateo County. We can now report that the response to this 
mailing was very low . *^ ; * 

« 

Posters with tear-off sheets were Sent to the libraries in Santa Clara County for post- . 
ing in local offices and govermnent buildings^ and a moderate response was obtained. 
Information was sent to those who filled out the tear-off sheet and some searcKes re- 
sulted from this. 

Some local spot radio announcements concerning computerized search in the library 
will be br&adcast in April and May- Production of a TV spot is still beirig considered, 
but there is the question as to whether the Broad coverage lA-ovided will cause confusion 
due to the fact that the public will be contacting libraries in the East Bay or Marin who 
know nothing about the service provided in tlie Peninsula area. * 
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Section- 3 
REVIEW OF SEAHCHES 

- ' / 

Although the libruries were offered freo review of searches when the fee pei'iod began, 
fow have taken advantage of this service. Because it was important for the fiJial report 
jiiunugraph that an understanding be obtained of factors that might cause soarcL failure, 
an exjiaustive review of searches was maiJe during this quhrfer. Statistics are Insuf?!^ 
fiuntly comproUensive to attach quantitative numbers to these factors, but they are 
listed l)elow in order of Importance. 

(1) Failure to EXPAND . This is probably the major failing noted, and is par- 
ticularly needed when author, report number, and patent number arc being 
StiLECTed. For example, EXPANDlngRN^PB 236148/3SL will show that 

a dash is missing after the PB. EXPANDlng of cited author's names is par- 
' ticularly required in SciSearch and Social SciSearcli, since the author's in- 
dividual refei*ences appear with the author name as in Fi^lEDMAN, M. , 
1968, Vol 28, p. 1. 

(2) Too Narrow a Search * This type of failure often occurs in fulltext S(!arcli 
when the soarcher specifies, for example, OIlTnOMOLECULAR(W) 
VITAMIN(W)THERAPY, and abandons the search when no citations Drc 
found. Instead, the searcher should combine separately ORTHOMOLECULAH 
AND the set obtained for VITAMIN(W}THERAPY. Another example is 
SMALL{W)B0AT(W)DAVIT, without subsequent broadening to BOAT(W)DAVrr 
or even DAVIT. 

(3) Nonoptimal Use of Data Bases * The librarians did not always choose the data 
base most appropriate to tlie subject areas. For example, Psyuh Ab«triicts 
eontalns niuLerial relevant to management science, NAL/CAIN contains ma- 
terial on food additives and the effects of [^stlcides, IMSPEG CompuLor» and 

^ ' C/Ontrol contains material on hospital automation and library automation, but- 
/ those wore not chosen by the searcher. 

12 
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(4) Failure to Type Out Citations . Often the corre^;search terms can be found 
by typing out a Station that satisfies a bro^*^e^ search. For example, a 
search of Psych Abstracts for MACH(W)SCDj&^ , MACH(W)SCOIlES, and 
MACH(W)TEST got zero citation, and the searcher abandoned the search. ' 

' Instead, a SELECT on the term MACH shoipld have been made and several 
citations should have been typed out. It would have revealed the term 
MACH ly SCALE in these abstracts, an^'a search on MACH(2W)SCALE ^ 
would have.given 25 such citations. , 

(5) Failure to Use Full Text . In some data bases it is necessary to use full 

text for terms that one migtit expect to find indexed but ajre not. For example, 
a search of Chem Abstracts for FERRATE H, FERRIC III, IRON H, and 
XRON.HI all give zero citations. A full text search on FERRATE (W)n, etc. 
is required to obtain' the recjuired citations. 

(6) The Use of the Wrong Term . If a librarian ig doing a hi^y technical search 
and does not knbw the vocabulary, then search errors can be made due to in- 
correct terms. For example, a search was made on QOMPUTER THROUGH- 
CUT, instead of COMPUTER THROUGHPUT, an^^e^^h was made on 
STRATIFIED CHARGED instead of STRATIFIED.CHARGE engine?. Having 
the patron attend the session can avoid this type of error . ' 

The review of searches indicates that it ij|%mportant fbr the searcher to be critiqued 
to avoid bad search habit patterns and to learn about techniques that should have been 
used. This type of review can be provided within the ^lublic library if reference librar- 
ies mutually review their searches; time and budget should be made available for this 
purpose to enhance the capabilities of the staff. * ^ - 
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Section 4 ' 
FINAL REPORT|mONOGRAPH - . 

« 

The outline of the Cinal^report monograph was distributed to the Oversigtit Committee 
and participating libraries for comment, as, given in Appendix B. The report wHl have 
three main chapters (1) Description of the Stucj^, (2) Evaluation, and (3) Guidelines 
and Recommendations. The appendix will cjontain statements concerning the experiment 
by participants and by the Oversight Commj^ttee. 

A meeting of the Oversigtit Committee will jbe held on June 3, 1976, to review a first 
Mraft of the monograph. A subsequent draft!, b^sed an these discussions, will be dis- 
tributed to particip^ts for review. 

\ " ' I ■ " ■ 
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Section 5 
PUBLICATIONS 



"On-line Reference Retrieval in a Public Library," R, K.' Summit and O, Firschein, 
Special Libraries, February 1976, pp, 91 — 96. _ - 

"The Cost of On-line Bibliographic Searching/' M, D. Cooper, N. A. DeWath, 
ACR-003-75-01, Applied Communication Research, December 1975, (to be published 
in a revised form in Journal of Library Automation, September 1976) 

"Effects of Fee for Online Reference Retrieval in a Public Libary Setting," O, Firschein, 
and R. K. Summit (accepted for presentation. at the 67th Annual Special Libraries Asso- 
elation meeting in June 1976) 
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During Pebrua^^y* each of the four libraries being added to the 
project were -visited. The purposes of the S«ir -visits were 

principally to arrsuige for data collection forms and secondly to obtain 
informa'ttlon about library operations. Brief descriptions of each of these 
libraries follow, ' '\ ^ 

HOUSTON I^UBLIC LIBRARY 

The .Houston Public Library serves the metropolitan Houston area and 

includes 25 branches, A fee-based refererlce service/ called Business 

/ ' ' ' ^ ' , 

Information Service (BIS), hi^ been^^in Existence at the library for ab<^ut 

one ydar prior to the introduction 6t DIALOG, BIS charges patrons $15 per 

hour, Howeyer, patrons aot have to go through bis to obtain a DIALOG 

search- Those patrons who have searches done independently of BIS are 

charged only for connect time and for off-line prints, ''No charges are 

made for staff .time- Currently, the reference department at the Houston 

Public Library handle about 21,000 reference requests per week- DIAIOG 

requests are a small portion of this work load- 

Although DIALOG service has been in operation in Houston for several 
months. Very few requests for the service have been received. The main 
patrons of the service are special libraries. The principal reason for 
the lack of use of the service is probably due to the facit that no 
publicity has been undertaken. In factr the only current publicity source 
is word-of-inouth. The library does have plans to publicize the service. 

One of the difficulties in publicizing the service, however « is - tho 
attitude of the staff at Houston towards fee-based services. Presently, 

17 
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the staff is in the process of re-ej^aluating the entire fee- for -service 
rationale^ There is a ^reat deal of concern among staff members about 
the image of the public library and how it will be affected by fee-t)ased 
services. In fact, there ^s strong reluctance towards charging for 
services at all. In Jjeeping with this philosophy, DIALOG requests are 
not funneled through BIS unless the^re is a time factor involved, i,e, 
rush jobs go through BIS, 

The Houston Public Library staff does feel that DIALOG service 
could be useful to the population the library serves. They hope, 
therefore,, to continue the service and h^ve already submitted a budget 
re^^uest for a terminal for next year, 

LONG ISLAND LIBRARY RESOURCES COUNCIL 

*^ 

The* Long Island Library Resources Council (LILRC) is one of nine 
regional corporations established by the New York State Commissioner of 
Education, The Council consist^ Of a group of library systems, institutions 
of higher education, ^ libraries, and other non-profit educational institutions. 

The Cooperative Information Services Committee (CISCO) of the 
lilLRC organiiifid and initiated DIALOG service. Project CISCO "is designed 
to provide or supplement access to machine-readable data bases which - 
might otherwise be unavailable to Long Island's research community.'* 

While members of the Council include a wide range of libraries^ 
public libraries are particularly encouraged to join. Annual membership 
dues are $25 per year plus fees for interlibrary loan service. Public 
libraries, however,, do not pay the interlibrary loan fees. Individual, / 
memberships in' the Cduncil were discontinued some time ago. 

' ' 18 ^ 
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Impetus for the project was actually .provided by tt^e Brookhaven 

\- \ - 

National Laboratory, which offered the use of 6ne of itd terminals to the 

, ft ' . 

Oouncil. In January, 1976, two sessions were held to acquaint reference 

librarians in Nassau and Suffolk counties with DIALOG seic^ice. Most searches 

completed since that time have been requested by librarians who attended 

one of the sessions, ^e cost of a search includes on-line time plus an 

overhead fee of $20 per hour. The overhead fee is intended to cover all 

costs' associated with the operation of the service. The terminal is 

provided by Brookhaven at no cost to LILRC. '"Publicity for the service 

has been limited to a brochure which was sent to ^11^ LILRC, members 

in JanuaVy. 

One of the o^rating principles of the service is that the patron 
does not have to be present at the time of the search, Also, LILRC 
does not normally provide documents for the patron after completion of 
the search. Instead^ patrons mbst go back to the iibrsucy at which the 
search was requested to obtain documents, A member library can, however^ 
then obtain documents through the Council by using th^ interlibrary loan 
procedures. Biding for the service is done dlrOctly by the individual 
responsible for conducting t±ie search. Bills ar^ sent on to the patron 
with the search results, 

LILRC has one staff ntember responsible tor conducting all searches. 
The Brookhaven temvlnal is. available teethe LILRC operator two mornings 
a week^ although arrangements for other times are possible, The staff 
members does try to spend as little time on-line as possible, by doing 
a great deal of off-'line search preparation. 

nhe LILRC will recommend alternate search services to a patron, ^specially 
if the patron wishes to be present at the time of the search. Adelphi 

19 
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University and the New York institute of Technology will do searches 
for outsiders for a fee. In addition^ the State University of New Vork 
will do searches for individuals on both BIOSIS and ERIC, } 

CLEVELAND PUBLIC LIBRARY ^' 

<t * 
The Cleveland Public Library serves primarily the city of Cleveland, 

although persons from all Northeastern Ohio regularly use the facilities. 

The library houses 3, 356, 515 volumes ahd includes 17 subject departments. ^ 

In addition to the central Main Library building, there are 3S branches. 

located through Cleveland.' 

In September, 1975, the library intitiate<4 "Facts for a Fee" - a 

fOe-based reference service - in response to requests for information 

beyond the scope of library policy on frjee research and outside the 

gieographical area of responsibility^ ' Facts for a Fee is aimed mostly 

at business and industry^. Tho service is available .on a contractual 

basis at $2S per hour- There is a minimum charge of $25. The staf£ 

includes three part-time individuals. Publicity for the seitVice has 

consis^^d mainly of brochures which were sent out to large companies in 

Northeastern Ohio. 

Reference service requests are screened by an office at the Main Library. 
Those requests which exceed the 15 minute time limit imposed on such 
requests by the library are referred to Facts for a Fee. Individuals making 

y 

such requests receive a brochure .from the library explaining the fee-based 
service^ In addition^ individuals coming to Facts for a Fee are given some 
evaluation by staff mtjmbers of whet;her or not it is profitable to have 
them conduct a reference search. Alternate suggestions are provided if 
the service is not considered to be profitable to the patron. 
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* 

DIALOG searches are offered through Facts for a Fee'. jCharges for the 

service include the cost of the data ba5e(s) used, the Facts for a Fee 

charge of S25 per hour, a communications charge of $10 per hour* and offline 

printing and photocopying charges where desired. There has been no 

publicity on the DIALOG aspect of the service to date. However* a DIALOG 

brochure is available for distribution and a new3 release about DIALOG iiB 

i 

being prepared for the Greater CleVelarid Growth Association Newsletter. 

One staff member is responsible for conducting all DIALOG searches. 
This DIALOG operator received a one-day training course from a Lockheed 
representative. Eventually the library would like to train othei 
librarians to conduct searches. Until this is possible, however* 
reference librarians in special departments are consulted when necessary 
on search topics, 

MINNEAPOLIS PUBLIC LIBRARY 

blALOG service at Minneapolis is operated through INFORM^ a fee-based 

research service of the Hinneapolio Public Library and Information Center 

whoso purpose is to provide information on demand and in a .useable form. 

The INFORM btaff conoistsj of one full-time librarian, ope part-tim*^-*' 

librarian^ and one clerical person. Charges for the service include 

$25 per hour for profosoional time, $10 per hour for extensive clerical 

tasks which requite little or no professional time^ and'charges for 

photocopying, long distance calls and any other expenditures made on behalf 

of the cliont. The minimum charge for a new client is $25. Clients are 

asked to present a letter of intent or sign a simple contract stipulating 

the search topic, any limitations on the searching time, and when the 

t 

information is to be presented* All search questions and clients' names 
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are kept confidential. Since 1970, INFORM has handled about 600 information 
searches annually, 

INFORM added DIALOG service in September, 1975, Publicity for DIALOG 
consisted principally of one article carried inN^the Minneapolis Tribune 
in September, 1975, Some advertising is also done in local and regional 
periodicals. However, word-of-mouth is responsible for most Searches, 

DIALOG searches are conducted as an integral part of the general 
INFORM service. Thus, searches are usually initiated by the INFORM 
staff rather than as a result of a dirept request from a client, INFORM 
staff have estimated that DIALOG can provide answers for between one-third 
and one-half of the inquiries received. One <if the main concerns, however, ■ 
is whether or not the computer search will be complete, quick and less 
expensive than the manual method, 

DATA COLLECTION FORMS 

Data collection forms for each of the libraries follow, Houston 

and Long Island use search request forms similar to those used by the 

libraries in California, Cleveland uses two different types of search 

request forms, one for individuals and one for business and industry, 

»■ 

The individual search request form is nearly identical to the one used 
in California, business search request form is similar to the 

one used at the Minneapolis Public Library, One of the major concerns 
ih designing forms for use by business was the policy of the Minneapolis 
Public Library to protect the anonymity of business patrons, 

22 
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Client ID Number 



(I.e. , attorneys , manufacturings advertising, etc • ) 



Level of administrative responsibility of client 



(I.e., manager, secretary , 1 Ibrarlan) 

If the endTUser of the requested information Is not the same Individual who 
places the search request with INPOKM, please also indicate the occupation 
of Che end"user: 

Occupation of end^user of information . 

Frequency as INFORM client: 

First Time Weekly 



Monthly 



Several Times a Year 



How did the client heaj: about the availability of INFOKM service? 



Date INFORI^ search lnitlated_ 
Date DIALOG used 



Date INFORM search concluded., ^ 

(Including retrieval of documents) 

DIALOG Information Files Used in Search; (Cheek all data bases used) 

_ERIC ^ABI INSPEC NAL/CAIN 

^P^ych, Abs. , Chew, Abs, 

Soc. Scl' . ! COMPENDIX 

Loijon Time \ ^ 



Eng, Index 

CHA/EHA 
Logoff Time 



Kr^idlngs n^A Sources Searched Prior to DIALOG: 



AIM/ ARM 



Bio. Abs. 



NTIS 



Other(speclf y) 



HtiadliPgs and Sources Searched After DIALOG: (indicate headings specifically 
suggested by DIALOG) ^ 




\ 



LMSC-D502175 



Number of documcntB sought from citations 
Number of documents actually obtained 



Source of documents (indicate all sources used): 

^ Minnaapolis Public Library ^Spfecial Library in Twin Cities* 



University of Minnesota 
Other (please specify) 



Explanation of Search: 

Why was a base chosen or not chosen 



Special Library Hot in Twin Cities 



Access in MPL to paper index same as DIALOG? 



Yes 



No 



Was additional paper index in same base needed after DIALOG? Tfes No 

Format Chosen: ^^Abstracts ^Citations ^Other 

Search Overview: . * 

Was INFORM search able to answer the question to client^s satisfaction? 



Was DIALOG a major or minor part? 



If the DIALOCT search wa§ run against a manual search, evaluate time and 
results: 



Total Cost of INFORM Search to Client 



19 

21 



^ I ' LMSC-D502175 

I PROJECT CISCO 
LONG ISM ND LIBRARY RESOURCES . COUNCIL 
BOX 31 i BELLPORT, NY 11713 SEARCH # 

Pl^ONE: (516> 286-0400 " . 




LITERjrURE SEARCH REQUEST FORM 

_ ^ 



. DATE OF REQUEST 



PLEASE TYPE OR PRINT CLEARLY DATE RESULTS NEEDED 

Name " 

Home Address Home Phone 



Business Address Business Phone 



Bill to : Home Bus iness 



Occupation Level of Education 



Originating Library .Originating Librarian 



1. Search topic. Please record^ in your own words ^ a full description of 

the subject on which you are seeking information. Be a^specific as possible 



2. List important term^ (^ords and phrases) and any synonyms or related t 
that you wish to include or exclude. Itndicate both scientific and com 
terms; feel free to explain terms and be as detailed as hecessary. 



erms 
common 



A.' 



3. List names of any people you know to be publishing ivOrk relevant to 
your question, ' t 



4. Language restrictions; None English only English and 

5^ Depth of search. Are you looking for (check one) 

_ All possible relevant citations A few relevant citations only 

Please estimate how many this will be ' 



6> tndicate maximum number of printed citations wanted (usually S-10<i each) 
^ If left blank, a maximum of 50 is sent. 50 100 (specify) 

mC ,0 25 
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7. Infcu^ation files . Please check those data bases you feel would be most , 
helpful in locating information on your search topic. Next to files checked 
indicate earliest year to be included in the' search. ' If no time limitation, 
[rite "All." ' 



ERIC 

PSYCH ABS 
^.SOCSCICIT 
OTHER(S) - Specify 



ABI/ INFORM 

NAL/CAIN 

PREDICASTS 



ENGIN. IND, 
CHEM ABS 
BIOSIS 
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Reason for search (check one): 

RESEARCH PAPER 

PERSONAL INTEREST 



_JOB 

SCHOOL ASSIGNMENT 



Othev (Please specify.) 



9. Hd* did you hear of the availability of the search service? 

LIBRARIAN NEWSPAPER ^Other (Please specify) 

NOTICE IN LIBTIARY FRIEND (Name) ^ 

REQUESTOR AGREEMENT : i ' , 

I 'understand the charges for tjAs search are based on the cost of the data 
bases(s) used, communication^^harge of $10/hr, CISCO charge of $20/hr and 
offline printing where desired. I agree to pay the search charf^es (not 
to exceed )- 



FOR SEARCHER USE ONLY 



Search conducted\by 



Date 



Logon time 



At 



Offline preparat ion tjlme 



Information files used in search: 
5, Client availability (check one): 

CI lent present at time of search 



SIGNATURE 



LogofC time 



Client available by phone at 
time of search 



Client not available at time of search 



Numberpf prints ordered 



st of search tX> library patron 
Minutes Data Base Tymshare 



Date prints received 
CISCO Prints 



8/ Billed date 



Amount 



O'^oyrn*^ nt recel ved 
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DIALOG E,VALUAT|)0N - CLEVELAND" PUBLIC LIBRARY 

Deadline , - Search Request No, 

. . ' . ^ ■ ^ . " 

This library is participating in a study, sponsored by the Nation^ Science 
Foundation, of public use of online retrieval terminals in public iibfartes.. 

To'determine the usefulness Of the OIAUOG system, both to the Ubrariati and to 
tibrary patrons* we Would appreciate it If you would provide us with the information 
requested on this form, A J 1 Information will Vema i n conf i dent J a1 and will be used 
^ Only for evaluation purposes. For a successful evaluation* It Ts Important to have 
access to as many patrons as possible, /However, we understand that some user* may 
prefer to remain anonymous; If you do /not wish to have your name used, please check 
the box at the bottom of the page and the librarian will block out your n£tme Before 
releasing this form to the evaluation consultants. ^ 



Thank you for' your coopteration 


in making this a successful study. 


NAME 


/ DATE 


^ 

HDME PHDNE , 


/ BUSINESS PHDNE ' ' 


HOME ADDRESS 




BUSINESS ADDRESS / 


! 


d/cUpatidn / 


LEVEL OF EDUCATION 


T 1 — 

1, Search Topic - Please record, /i 
on which you are seeking inform 
« f 


n your own words, a full description of the subject 
ation. Be as specific as possible. 

1 — ■ 



1. 



List i mportaht^ tefms (words/ and phrases) and any synonyms or related terms that 
you v^ish to include ar excijude. Include both , scient i f i c and common terms. 
Please feel free to explain terms and to be as detailed as necessary,. 



TERH^ 



SYNDNYHS 



EXCLUDED USES 





I do not wish to have my name released,!* I 
22 ' ' ' ' 
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3* List, specific references or names of any people that you know to be publishing 
work relevant to your question. 

Language restrictions: None English only English and 

5* List years relevant to your Search^ ' 



6. Information Files - Please list those information files that you feel would be 
most helpful in locating information on your search topic. 

7* Reason for Search (check one); - ; 

^Job ^Research Paper Persona 1 I n teres t Other(speci f y) 



8. How did you hear about the availability of DIALOG service? 
Librarian Mai led notice ^Friend(narfie) 



N6tice in library Newspaper Ot:her^speci fy) 



3* To aid |n this evaluation, would you be willing to be contacted to provide some 

brief follow-up information on your satisfaction with the results of your 

search (check one)? Yes ^No \ 

Thank you for your assistance. ' 



SEARCH DATA - TO BE FILLED OUT BY PERSON CONDUCTIN 



i^Srch^ 



1. Person Conducting Search 



2. Date - Logon Time ^Logoff Time 

3. Off-line Search Preparation Time '_ 



4. Information Files Used in Search: (List all data bases used. Please^place an 
asterisk next to any data base which was searched but did not provide citations.) 

5. Person^.Doing Search (check one): 
^L ibrar lan ^ I f en t (a lone) 1 lent (wf th Jtbrar ian ass ! stance) 

6. Client Availability At Tinie of Search (check one); 
^Client Present Client Available by Phone ^Client Not Available \ 

7* Were the search results (check ope): 

Picked up at main library P i eked up at branct^ library H a) led to client 

, n_ii^.LXj-M- 

Number of off-line prints ordered ^Date prints received 

9. Cost of Search to Library Patron 

• 23 
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DIALOG EVALUATION - CLEVELAND PUBLIC L ( BRAF(Y 



Search Number 



Type of FI rm 



Level of admtn i strat t ve responsibility of client . [ ' 

(i.e., ^.manager , secretary , 1 i brar i an) 

If the end-user of the requested information is not the same individual who places 
the search request, please also indicate th6 occupation of the end-user: 



Frequency as client: 

First Time \ Weekly j Monthly Several Tlmes^ a Year 

How did the client hear about the availability oj^ the service? 



Date search lnitlated_ 

Date OlALOG used [ 

' ' - -. ^ 

Date search concluded (including retrieval of documents), 

■ .^-^ - 

DIALOG Information Files Used in Search; 



Logon Time ^Logoff Time 

Headings and Sources Searched Prior to DIALOG: 



Headings and Sources Searched After DIALOG: (indicate headings :spec i fi ca I iy 
. suggested by DIALOG) , ^ 



■7—7 



0^ 
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Number of documents sought from citations 
Number of documents actually obtained 



Source of documents {'indicate all sources used): 

1 eve 1 and Publ i c L i brary S pec i al L I brary 



Local Urrlvers it ies O ther (please specify) 



Explanation of Search; ^ 

Why was a base chosen or not chosen 



Access in CPL to paper index same as DIALOG? ^ Yes N o 

Access in area to paper index same as DIALOG? Y es No 

Was additional paper index in same base needed after DIALOG? Yes No 



Why? . 

Format Chosen: Abst racts , C i tat ions Other 



Search Overview: * 

' Was search able to answer the question to client's satisfaction? 



Was DIALOG a major or minor part? 



If the DIALOG search was run against a manual search, evaluate time and 
results: 



\ 



Total Cost of Search to Client 
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DIALOG SEARCH REQUEST - HOUSTON PUBL L I BRARY 

Search Heirue^t Number * 0rl9lnAtln9 LlbrarTan 

St?arch Oe*idl \nc 



The Hou^Lim Public Library ts ^ar 1 1 c1 pat t rvg tn a »tudy* ^pon^Orcd by the National Science 
ruundatton, of public u«e of on-Hne retrtevat terminate tn Public Vfbrarte^. 

Tf> determine tKe u^efutne^^ of the DIALOG ^yMem, both to the U brar I an^'Vid to library 
Patron^r we would appreciate U If you k^ould Provide u« with the tnr6rfnatton requested 
on th t « form. AIT t nformat ton wH I remain confident la) and wtl I be u^ed only for 
evaluation purposes. Tor a «ucce««ful evaluation^ It M lioportdnt to have access 
to a» many patrOn^ a» po^^lbte. However, we understand that some users m&y prefer to 
retnatn anonymous. If vou do not wish lo have v^^r name uSed* pledSe cheek the boK 
at the bottotn of the Pa9e and ihe llbrarf^n wt M btoek out your name before 
releasin9 this form to the evaluation consultants. 

Thank you for your cooperation In maktn9 this a successful S^tudy. 



1„ ""^^^ 



HOKE/BUSINESS address HOMt/&Uf INtSS PH^Nt 



BUSINESS WArtE , . 

OCCUPATION^ _ LEVEL OF tOUCATlON_ 



1. Search ToPlc " PledSe record* In your own words* a full description of the Subject 
on which you are seeking^ informotton. Be as Specific as po^^tbte. 



Z. Based upon the toptc^ the search objective Is to: 



List Imporlrtnt terms (wr>*tts -ind phr.ises) ,^n*l 4ny i^ynonymS or ^elAted tcrnii that 
ynu wish lo Include or oxc1u<fet Include Ixflh Scientific and cornnon terms. Plei^Se 
feel free to eitptain It-rmS anti tO be as flt^lYitled Ai^ neeeS*rary; 

Ttflrt SYHONYrtS tXClUDtD USES 



L I si Journals and/or authors that are most likely to produce good results^ 



I do not wish to have ^ name released, F/ I 
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5, En9Hsh ian^juagc only? Yes Mo Oth^r languagcs^ ' 

6, OePUi of Search - Are you )ooktn9 for (check one): 

J S 1 1 Possible rcl<rvanC citallons A f^w relcvani citations only 

7* I would HHc outPut to be (check one): 

Citations Citation and abstracts (If abstrdcts available In dat* 

bi»se(3) dccesfted) 

8, Information Files - Please check those Information files that you feel wOuld bo 
moftt helpful In locat tn9 Information On your search topic. Also, PLEASE WRITE 
HIXJ TO THE FILES CHECKED THE HAXIHUH VEAR TO CO BACK TO FOR THE SEARCH- 

ERIC _ABI tMSPEC HAL/CAIH ^AlH/ARH 

Psych, Abs. Chem Abs. CMA/EMA ^ JiTIS I OS IS Prev, 

Soc, 5cl, CU. _CO«PEMDEH Predicants ^Ot her (spec I f y) 

9, Reason for sodrch (check one); 

_^ Job R esearch P^kPer P ersonal Interest 
School Assl9ninont Other (please specify) 

10. Was search sur|r|estod by (check one): 
Librarian ^Client 

IK How aid you heer about the availability of DIALOC service? 

Librarian ' Hailed notice Fr 1 erul (name) 



Hot tee In 1 Ibr^ry H^sPePer , Other (spec I fy) 



l2. To Aid In fhts evaluation, would you be wl11tn9 to be contacted to provide some 
brief foMow-up. Information on yOur satisfaction with the Vesults of your. search? 
(check one) Tes ^Mo 

Th^nk you for your asslstEinCe, 



SEARCH DATA-- To be filled out by Person conducting search. 



Person con<fuctlng seflrch_ 



2, Oate Logon Time Logoff Tlfno_^ 

3, ^Off*llne setrch Preparation time 



InformatJOrt fUei uled In search: (check all dota b<)ses used * Please place dn 
aiteflsk next to any data bale which was searched but dJ4 not Provide cltetlonSi) 

^£RIC ABI _'jMSPEC flAL/CAlM ^ftin/ARM 

^F>sych. Aba, ^Chem Abs, ^CHA/EHA ^MTIS BIOSIS Prev, 



_Soc, Scl, Clt, COmPEHDEX ^PredlcastS ^Ot her (spec t fy) 

5, Client Q^c^t labt 1 1 ty at time of search (check one): 

Client present ' C I lent available by phone Client not avaHeble 

6, Were the. learch results (check One) i 

J*lcked up at library Hailed to client 

7, Number of prints ordered Date prints received 

fi, jCoft of aeerch to llbr^^ry patron ^ - 

9, Connenta; 
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OUTLINE OF FINAL REPORT MONOGRAPH 
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EXECUTIVE SUMMARY 

PAHT 1: DESCRIPTION OF THE STUDY 

1.1 Goala of the Study 

(To Investigate the role of the Public Library as a linking agent between th^ public 
and the many macliine- readable data bases. To determine the Impact dn the public 
and on the library; to establish guidelines for libraries considering online retrieval.) 

1.2 Structure of the Study * 

1.2.1 Organizations 

• Lockheed Information Systems provides DIALOG service and project 
management 

• Applied Communication Research provides the evaluation 

• Participating CIN libraries (San Jose» Redwood City, Santa Clara County^ 
San Mateo County) provide reforehco librarians and patron contact point 

• Additional libraries - Houston, Minneapolis, Cleveland, and Long Island 
* Library Resources Council — provide 6-month test of full-fee charge to 

patron ^ 

• Oversight Committee advises on project 

1. 2. 2 Design of the Study 

(One-year free service and one-year one-half cost service, plus terminals and training 
taCIN libraries. Six-month terminals and training only to other libraries. CIN Ubrar- 
ies to be provided with two free terminals for the tlilrd year*) 
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1.3 Training and Tutorial 

Training provided r 2-day DIALOG standard training; attendance at Palo Alto Users' 
Meeting; selective attendance at data base meetings. 

Search crituques and tutorial notes. * 

1.4 Publicity 

Chronology of publicity efforts. 

Types and examples of publicity generated (posters, flyers, newspaper publicity, 
demonstrations, etc.) 

Effectiveness of various publicity media. 

1.5 Terminals 

The Tcrmenet Terminal 

Sound-proofing rpqulrements 

Line, voltage variation problem at Redwood City 

TWX terminal 

PART 2: EVALUATION 

2. 1 Analysis of System Use 

(ACR analysis of who the patrons were, patron satisfaction, utilization of the system 
in free and fee period, etc,) 

V 

3.) 
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2,2 Etfoct on the library 

(ACR Interviews with librarians and library administrators concerning impact of 
computerized search as well as advantages and problems,) *r 

> 2,3 Time Required for Search 

(Summary of Cooper/ttewath study of online and offline time,) 

PART 3: VARIOU^ ASPECTS OF COMPUTERIZED SEARCH ^ 

3.1 Financial 

Problem Of overload in a free service aetUrig, 

Mechdnlcs of fee services: forms used, fee collection » need for an indication of search 
cost after each search. 

Pressures on the librarian tn a fee for service environment, 
AltiirnaUvos for charging, e,g, , credit cards, accounts 

3.2 Marketing and Publicity 

Lessons learned about media to bo used, 
^bllclty and tutorial tools needed, 
3, 3 Administrative Aspects 



ERIC 



Staff time requirements (required for co^ipletlng forms amf keeping records, explaining 
DIALOG to patrons , training time , performing searches), 

3Q 
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ERIC 



Source document fulfillment (many sources available in Bay area, may not be true 
elsewhere), 

3,4 Maintaining Search Proficiency 

Training requirements 

Critiquos and reviews of searches 

Need for formalized practice and review sessions 

PART 4: GUIDELINES Alto RECOMMENDATIONS 

4.1 Guidelines for Libraries Considering OnliYie Search 

Are there patrons y/ho require in-depth search (college students, professionals , 
governmental people, etc.)? ^ 

Interest and enthusiasm and time on the part of the administration and the reference 
librarians, ^ ^ 

Need to establish policies and procedures to handle workload. 

Adequate budget for staff time, terminal, publicity^ and search time. 

WilUn^ess to promote the service. Need for patience until system catches on. 

Problem of central reference service obtaining questions from branches. 

4.2 Recommendations for Future Study 
Study of non-users of the reference services. 
Study of the '*turnaway" problom at the library desk. 
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Study of searcher behavior -analyaia of learning patterns. 

Diffusion of information -r how do patrons find out about the system and how do they 
spread the word? 

4,3 Summary and Conclusions 

itosulta achieved. Evaluation and publicity products useable by other libraries. 
APPENDIXES 

A. Statements on impact on the library, perception of usefulness^ advice to other 
libraries by , - 

• Library management and reference librarians 

• Members of the Oversight Committee 

B. Examples of Evaluation Forms Used. 
Publicity Material Used. 

D. Annotated Bibliojjraphy. 
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Appendix C 

INTERESTING QUESTIONS RELATED 
TO THE STUDY 
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'^QUESTIONS CONCERNING THE STUDY 

f orreet Carhart has providod the following breakdown for analyzing the atudy: 

• Feasibility 

• liconomic viability 
% Utility to users 

• Impact on the library 

• Impact on the users 

• Marketing variables ' 

We have modified this breakdown slightly, and gathered together the varioue questions 
asked by the Oversight Committee over the course of the project, as well as the original 
set of questions in the proposal in order to stimulate thinking on the final monograph. 

POUCY 

• What does the 01A1_,()G experiment portend for the future of tho library? Is it 
just another item U> fit into tho traditional library package of services, or is 
it a significant new modo that may require fimdamontal changes and new 
approaches to library conceptualis^ation and organization? (Rubonstain) 

• What is the future role, organia^ation, aspirations etc-, of the public library 
versus the college and specialized library? (Rubensteln) 

FKASIBIUTY 

V 

^ Under what clreumstancea la It appropriate for a public library branch or 
aystpm to offt^ this type of aervioo? (Bourns) 

MARKETING VARIABLES ^ 

• What promotional tochniques are required? 

• What is the effect o( price to user on demand for tho system ? 
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m Wliat are the factors for successful marketing of such a system in a public 
library setting? 

ECONOMIC VIABIIiTY 

• Economic: Is there a rationale to support different fees for different typei? 
of users? (Geller, Ferjguson) , , 

'.jm Economic: Are there any potential off'-setting cost reductions caused by 
DIAIX)G, e.g., service subscriptions? (Geller) 

• Economic: What are the implications for support of other tjrpes of reference/ 
information services, given th^ fee-for-service example of DIALOG?! (Geller) 

UTILITY OF USERS 

t 

• What i^e the characteristics of the users?. 

• What are the user reactions- to the system? 

• What additional information resources do the users require? 

• What data bases are most useful in a public library setting? 

• What impact does the system have on the user ? 

IMPACT ON THE LIBRARY 

• How much stall time is required? 

• What training and proficiency maintenance effort is required? 

• How does the online system effect other library services? 

• Is there a problem in providing source documents? 

GENERAL CONSIDERATION CONCERNING THE STUDY 

• Anything special about the geographic area or participating libraries in this 
e>^periment? Would the results of this study have been any different if the . 
project were run in Oregon, Nevada, Montana? (Bourne) 
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n Are the results of this project directly transferable to any other public 

« 

library t>r public library system ? (Bourne) ^ 
' o Was there any ^pecial advantage to the end user to having this service provided 
from a building with the label "library.** Was there any added value to the user 
that could not be obtained if the end user obtained the search service from a 
commercial search service located next door to the library? (What is the 
special, advantage to the user to have this service available from the library 
instea4^of some other outlet?) To what extent did the users in this experiment 
actually realize any such extra advantages? (Bourne) 
> If you were to start this exercise ^11 oyer again, but perhaps in a different 
area, what would you d<i differently? (Bournq) 

• Wpuld all of your generalizations and conclusions apply if the search service 
^ were SDC of instead of Lockheed? ^(Bourne) 

OPERATIONAL CONSIDERATIONS ' . • 

• " How many people actu^Iy ended up as uie acttial terminal operators at each 

facility? (Bourne) ^ 

• What wer^, the Interface mechanisms between the library system (and DIALOG) 
aiKl the end user, and how did these work put? (Bourne) 

• Any particular personnel problems? (Bourne) t 

e What was the degree of library coommitment and willingness to provide the*; 

neces£^ary support^and subsidy) to these services? (Bourne) ^ 
ft Should/could you have terminals at each brarfch? (Bourne) 
o Is there some recommended equipment mix and communications arrangement 

for each Installktlon? (Bourne) 
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